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SYSTEM AND METHOD OF MANAGING DATA TRANSMISSION LOADS 

BACKGROUND 

Field Of The Invention 

Aspects of the present invention relate generally to managing data traffic 
5 transmitted across a communications network, and more particularly to a system and 
method providing distribution of data packets among a plurality of call control 
modules. 

Description Of The Related Art 

Recent advances in Internet Protocol (IP) data transmission techniques and 
10 wireless communications technologies have led to increasing popularity of internet- 
based telephony and various other packet-switched data communications services. 
Conventional systems have proposed internet-enabled or web-enabled call interfaces 

Has? ~"~ 

*fi which are capable of managing packet-based voice and data communications. These 

i2 systems typically enable IP or web communications services through implementation 

'if 15 of a call processing server, i.e. server-side call processing hardware and software 

!H operative for call initiation and management. 

Conventional server-based call processing methods and hardware platforms 
are often inadequate to accommodate the volume of communications traffic for 
which the server is responsible. As new users are attracted to the services provided 
20 by the current technology, data transmission volume often increases beyond the 
limits of the network infrastructure employing conventional techniques; 
consequently, the frequency and magnitude of communication delays due to network 
traffic continue to worsen. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 FIG. 1 is a simplified high-level block diagram illustrating a data 

communication network environment in which a system and method of data traffic 
load management may be employed. 
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FIG. 2 is a simplified high-level block diagram illustrating one embodiment 
of a distributed server arrangement implementing a data traffic load management 
strategy. 

FIG. 3A is a simplified block diagram illustrating the form and composition 
5 of one embodiment of a Call Control Server Table. 

FIG. 3B is a simplified block diagram illustrating the form and composition 
of one embodiment of an Active Call Control Server Table. 

FIG. 4 is a simplified block diagram illustrating the form and composition of 
one embodiment of a heartbeat message. 
10 FIG 5 A is a simplified flow diagram illustrating one embodiment of a 

method of creating an Active Call Control Server Table. 

FIG. 5B is a simplified flow diagram illustrating the general operational flow 
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FIG. 6 is a simplified flow diagram illustrating the general operational flow 
1 5 of another embodiment of a system and method of managing data transmission loads. 

DETAILED DESCRIPTION 

Embodiments of the present invention overcome various shortcomings of 
conventional technology, providing a system and method of managing data 
transmission loads enabling substantially uniform distribution of incoming data 
20 packets among a plurality of data processing modules. 

In accordance with one aspect of the present invention, a system and method 
of load management implement a plurality of call control computer servers, each of 
which may be responsible for a limited range of data processing tasks. In one 
embodiment, for example, a load manager may distribute incoming data packets in 
25 accordance with the particular network transaction with which the data packets are 
associated as well as the present load at each of the plurality of call control servers. 

In some embodiments, a load management system and method may 
implement a dedicated load management server employing a hash function to direct 
incoming data traffic substantially uniformly across a plurality of call control 
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servers. Such distribution of data traffic loads may facilitate optimum allocation of 
system resources. 

The foregoing and other aspects of various embodiments of the present 
invention will be apparent through examination of the following detailed description 
5 thereof in conjunction with the accompanying drawings. 

Turning now to the drawings, FIG. 1 is a simplified high-level block diagram 
illustrating a data communication network environment in which a system and 
method of data traffic load management may be employed. A communication 
network 100 may be configured to facilitate packet-switched data transmission of 
10 text, audio, video, Voice over Internet Protocol (VoIP), multimedia, and other data 
formats known in the art. Network 100 may operate in accordance with various 
networking protocols, such as Transmission Control Protocol (TCP), Internet 
!Yr,rr,fr.! .'TP X . TT ^ — — i rnxxm q;^u a /fail Tronofar D™t^™i 

(SMTP), Asynchronous Transfer Mode (ATM), Real-time Transport Protocol (RTP), 
"~ 15 Real-time Streaming Protocol (RTSP), Session Announcement Protocol (SAP), 

Session Description Protocol (SDP), and Session Initiation Protocol (SIP ). A system 
and method of managing data transmission loads may be employed in conjunction 
;L, ? with numerous other protocols known in the art or developed and operative in 

SJ accordance with known principles. 

3 20 Network access devices 121 and 122 may be connected via one or more 

■f communications networks 111 and 112 enabling two-way point-to-point, point-to- 

multipoint, or multipoint-to-multipoint data transfer between and among network 
access devices 121, 122. Additionally, network access devices 121, 122 may be 
coupled with peripheral devices such as, inter alia, a telephone 151 or wireless 
25 telephone 152. Network access devices 121, 122 and any attendant peripheral 
devices may be coupled via one or more networks 111, 1 12 as illustrated in FIG. 1. 

For simplicity, data communications such as the foregoing, i.e. involving 
network access devices 121, 122, may be discussed in the present disclosure with 
reference to calls. The term "call," as used herein, may refer to audio transmissions 
30 (e.g. voice, digital audio, or telephone signals), video data, text-based services (e.g. 
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"instant text messaging" or "short message service"), multimedia-based messages, or 
any other packet-based data communication as is known in the art. 

Calls may be any real-time or near-real-time audio, video, text, or 
multimedia-based message transmissions across a computer network (i.e. an "on- 
5 line" message transmission). Examples of such transmissions include, but are not 
limited to, user-to-user or user-to-multi-user communications involving electronic 
conveyance of one or more digital messages such as data packets. Accordingly, 
examples of calls may include the following: electronic text "chat" or "talk" 
messaging; electronic mail (e-mail); instant text messaging; video-conferencing; and 
10 internet or other IP-based telephony, which may employ VoIP. 

In some embodiments, for instance, network access devices 121, 122 may be 
personal desktop or laptop computers, workstations, personal digital assistants 

^n^^«\ p«*n rt «„1 /»rt^mnm/io+irt«n nt»ptarwo /'D/'^Cc^ ii7irotooc f alonKntioc rvr rvtlior 

network-enabled devices. The scope of the present disclosure is not limited by the 

15 form or constitution of network access devices 121, 122; any apparatus known in the 
art which is capable of data communication on networks 111 and 112 is within the 
scope and contemplation of the inventive system and method. 

Each individual network 111, 112 may also include or be coupled, either 
directly or indirectly, to other networkable devices known in the art in addition to 

20 telephony infrastructure, such as telephone network server 130 and wireless 
telephone base station 140. It is well understood in the art that any number or variety 
of computer networkable devices or components may be coupled to networks 111, 
1 12 without inventive faculty. Examples of other devices include, but are not limited 
to, the following: servers; computers; workstations; terminals; input devices; output 

25 devices; printers; plotters; routers; bridges; cameras; sensors; or any other 
networkable device known in the art. 

Networks 1 1 1 and 1 12 may be any communication network known in the art, 
including the Internet, a local area network (LAN), a wide area network (WAN), a 
virtual private network (VPN), or any similarly operating system linking network 

30 access devices 121, 122 and similarly capable equipment. Further, networks 1 1 1 and 
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1 12 may be configured in accordance with any topology known in the art such as, for 
example, star, ring, bus, or any combination thereof 

In operation, servers, such as telephone network server 130, for example, 
may be configured to allow two-way data communication between different 
5 networks, such as networks 111 and 112 as depicted in FIG. 1. Additionally or 
alternatively, telephone network server 130 may communicate with a public- 
switched telephone network (PSTN), plain old telephone service (POTS) network, 
Integrated Services Digital Network (ISDN), or any other telephone network. As 
illustrated in FIG. 1, telephone network server 130 may be coupled to wireless base 
10 station 140 supporting two-way data communication between telephone network 
server 130 and wireless telephone 152. 

A system and method of managing data transmission loads may be 

l=J HIipiCiiicuLCu at icicpiIOuc hciTvvv/Fjv SCTVCi 130, for CXdmplc, CT Zt CT mere 

% fji physical machines distributed on networks 111, 112. Though a multi-server 

^ 15 embodiment is illustrated and described below with reference to FIG. 2, those of skill 

=p in the art will appreciate that a load management system and method may be 

embodied in a single computer server having one or more software programming 
^ routines or modules dedicated to load management functionality. The multi-server 

\f FIG. 2 arrangement is provided by way of example only, and not by way of 

^ 20 limitation. 

□ FIG. 2 is a simplified high-level block diagram illustrating one embodiment 

of a distributed server arrangement implementing a data traffic load management 
strategy. The server-side of a network-based communications system may include a 
distributed computer server arrangement 270 which may generally be constituted by, 

25 inter alia, a Load Manager (LM) Server 271 and a Call Control Server Farm 279. 
As indicated in FIG. 2, Server Farm 279 may generally include a plurality of Call 
Control (CC) Servers 272-277. 

In one embodiment, server arrangement 270 may be characterized as a tiered 
server platform having a "master" server influencing or managing the operation of 

30 one or more "slave" servers, as is generally known in the art. In the FIG. 2 
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embodiment, for example, LM Server 271 may be configured to act as a master 
server governing the operation or functionality of the various CC Servers 272-277 in 
Server Farm 279. 

With reference to components illustrated in both FIGS. 1 and 2, it will be 
5 appreciated that telephony clients 250 may include telephone 151, wireless telephone 
152, a PCS or PDA, and other communication hardware discussed above; 
additionally, advanced clients 220 may generally correspond to computer-based 
network access devices 121, 122 discussed above. As noted above, server 
arrangement 270 may generally be physically situated on, or accessible through, 

10 networks 111, 112. In one embodiment, for example, server arrangement 270 may 
be integrated into a corporate LAN, WAN, or VPN, and have access to data and 
resources residing on other servers which are part of the network. Data transmission 
loads and cail processing tasks may be distributed by LM Server 271 among the 
various CC Servers 272-277 such that overall system resources are allocated 

15 efficiently. 

With respect to server arrangement 270 in general, high availability and 
scalability may be achieved through the implementation of Call Control Server Farm 
279. The arrangement depicted in FIG. 2 is provided by way of example only, and 
not by way of limitation. For example, server arrangement 270 may be implemented 

20 in a single physical machine wherein LM Server 271 and CC Servers 272-277 each 
may be implemented in the form a dedicated software or firmware module. As 
another example, while Call Control Server Farm 279 is illustrated as comprising six 
CC Servers 272-277, those of skill in the art will appreciate that the Server Farm 279 
may be scaled to include any number of such CC Servers or software modules 

25 without inventive.faculty. 

In one embodiment, each CC Server 272-277 may host a Connection Logic 
Control/Session Logic Control (CLC/SLC) pair. As is generally known in the art, 
the CLC may engage in basic processing of data messages and network transactions, 
such as handling call setup and call tear-down, for example; the SLC may manage 

30 more advance processing related to the call, such as identifying recipients and 
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resolving packet destinations, as well as handling advanced features such as call 
forwarding, call blocking, and the like. 

As noted above, LM Server 271 may distribute incoming data packets, such 
as SIP messages, for example, substantially evenly or uniformly among CC Servers 
5 272-277 in Server Farm 279. In turn, each CC Server 272-277 may apprise LM 
Server 271 concerning its current load status and residual processing capacity; 
firmware and load management software program logic, for example, at LM Server 
271 may optimize system resources across the entire Server Farm 279. 

Server arrangement 270 be provided with a single IP address for access by 
10 clients 220 and 250; in the FIG. 2 embodiment, for example, LM Server 271 may 
represent a single IP address for the entire server arrangement 270 with respect to the 
rest of the network universe. In other words, one IP address for LM Server 271 may 
effectively become ihe IP address of the entire range of CC Servers 272-277 in the 
k g Call Control Server Farm 279 as well 

;J 15 In this embodiment, LM Server 271 may receive all inbound data 

»P transmissions destined for data processing; in packet-switched data communications 

in 

\j networks, such data transmissions may comprise data packets, such as SIP messages, 

for example. As noted above, LM Server 271 may selectively distribute incoming 
SI data packets across one or more CC Servers 272-277 in accordance with the present 

E . 

q 20 load at each CC Server 272-277, for example. To facilitate such distribution, LM 

!=f Server 271 may execute (or cause to be executed) firmware instructions or software 

program code operative to monitor the current load status and remaining processing 
capacity of each CC Server 272-277 in Server Farm 279. By way of example, LM 
Server 271 may selectively direct new data traffic only to CC Servers 272-277 
25 having sufficient, currently available processing capacity to accommodate the newly 
directed load. 

In the FIG. 2 arrangement, LM Server 271 may be responsible for executing 
two primary functions: maintaining the number of messages or data packets sent to 
each CC Server 272-277 relatively even or substantially uniform; and routing all the 
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messages or data packets corresponding to a particular network transaction or data 
communication to the same CC Server 272-277. 

The above-mentioned functions may be achieved, for example, through use 
of an identifier for each data packet which is unique to the network transaction with 
5 which the data packet is associated. For example, the Call ID field of a SIP message 
may be an appropriate identifier which may be used to index into a randomly 
dispersed table, as described below. As another example, HTTP packets may 
contain a similar unique identifier which may be parsed from the packet header. 

Where each CC Server is provided with a "CC Server ID" value, for 

10 example, or some other unique identifier, use of a hash function may enable 
consistent calculation of the same CC Server ID value for each message or data 
packet having a particular Call ID (i.e. related to the same network transaction). In 
that regard, a hash fuiiciiuii may be implemented such that its output range may be 
selectively greater than the number of active CC Servers in the Server Farm 279. 

15 Additionally, hash function output may be input to a modulo function in accordance 
with the number of active CC Servers in the Server Farm 279. In the foregoing 
manner, every data packet having a particular value in the Call ID field may be 
forwarded to the same CC Server 272-277. 

Further, since the current load capacity at each CC Server 272-277 is 

20 monitored as described below, data packets related to new network transactions may 
be distributed such that each CC Server 272-277 in Server Farm 279 may experience 
a substantially uniform data traffic load relative to every other CC Server 272-277. 

In operation, each CC Server 272-277 may use broadcast messages, for 
example, to notify the system and LM Server 271 of its present load status and 

25 residual processing capacity. It will be appreciated that such a broadcast message 
may employ a common or simple protocol such as User Datagram Protocol (UDP), 
for instance. In this embodiment, LM Server 271 may monitor such broadcast 
messages to create and to manage a data structure, such as a CC Server Table, for 
example, containing data related to known CC Servers 272-277. Such a table may 

30 have a static size which may be determined when a load management application 
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(resident on LM Server 271, for example, and containing executable load 
management program instructions) is started or initiated. 

A static table size may generally limit the total number of servers which may 
be recognized and managed by an executing load management system and method. 
5 In an alternative embodiment, a dynamic table of known servers may be maintained 
to support desired scalability and fault tolerance; for example, a dynamic table of 
servers known to be active or responsive may be maintained as set forth in detail 
below with reference to FIGS. 3B and 5 A. 

A system and method of managing data transmission loads may employ a 
10 passive timeout strategy for failing CC Servers 272-277. To support such a timeout 
strategy, each CC Server 272-277 may be configured with a "heartbeat," for 
example; a heartbeat may be a periodic signal which is broadcast or sent at 
predetermined intervals. That is, an executing CC Server 272 277 may broadcast or 
send a heartbeat signal at a defined time interval. Each heartbeat signal, in turn, may 
15 update a timestamp or counter associated with the server sending the heartbeat 
signal. Data records related to such timestamps or counters for each known CC 
Server 272-277 may be maintained at LM Server 271, and may provide an indication 
of the responsiveness of each CC Server 272-277 in the Server Farm 279. 

■%l In this embodiment, load management application software or firmware at 

IjJ 

P 20 LM Server 271 may additionally be configured with a server heartbeat decay value 

-'3SS; 

l=f corresponding to the amount of time that a particular CC Server 272-277 may be late 

in reporting its status. Depending upon overall system configuration, a suitable 
decay value may be some small multiple (3x-5x, for example) of the server heartbeat 
period. In conjunction with accessing a CC Server Table entry, for example, the load 

25 management software or firmware may check the timestamp associated with each 
CC Server 272-277; if the timestamp entry is outside of a predetermined range (e.g. 
above a predetermined threshold), the load management application program may 
fail the late or non-responsive CC Server 272-277. 

One recovery strategy for a failed CC Server 272-277 may be to access the 

30 next CC Server 272-277 in the Table. In the case of multiple failed CC Servers, a 
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load management system and method employing this strategy may cascade through a 
number of failed CC Servers until a valid or operational alternative is found. Failure 
to find a valid CC Server may result in message loss. 

As an alternative, a modified table, for example, derived from the CC Server 
5 Table, may contain only active, or currently "good" or responsive, CC Servers. Such 
an Active table is described in detail below with reference to FIG. 3B; in an 
embodiment which only accesses such an Active Table, a cascade through one or 
more failed CC Servers may be avoided, since every CC Server in the accessed 
Active Table has been confirmed to be responsive. 
10 By way of example only, FIG. 3 A is a simplified block diagram illustrating 

the form and composition of one embodiment of a Call Control Server Table which 
may be employed by a system and method of managing data transmission loads, 
inougn omy one iummi or oti ver ± aoie joG is shewn, it wii! be appreciated that 
vS different formats may be appropriate, depending, for example, upon the general 

3 ^ 15 system configuration, the network communication protocol, or a combination of 

=P these and other factors. 

Ill 

The entry in the Index column 310 may represent an identifier for each CC 
Server in Table 300, such as the CC Server ID value discussed above with reference 
to FIG. 2. As indicated in the exemplary Table 300, each CC Server may be 
20 numbered contiguously, starting at 0. This unique identifier may be used as an entry 
index into Table 300 for a particular CC Server. Table 300 is illustrated as having a 
number, n, of entries corresponding to the number of CC Servers in the Server Farm. 

The entry in the IP Address column 320 may represent the BP address of the 
associated CC Server; the EP address may be used to forward any data messages (in 
25 this example, SIP messages) intended for a specific CC Server identified by the 
index field in the Index column 310. 

The entry in the SIP Port column 330 may represent the port to which SIP 
messages bound for a particular CC Server may be directed. The entry in the 
Timestamp column 340 may represent the system clock time when the last message 
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was received by the associated CC Server. Finally, the entry in the State column 350 
may represent the status of the CC Server as reported in its last heartbeat message. 

FIG. 3B is a simplified block diagram illustrating the form and composition 
of one embodiment of an Active Call Control Server Table (Active Table) which 
5 may be employed by a system and method of managing data transmission loads. The 
format and general composition of Active CC Server Table 360 corresponds to CC 
Server Table 300 shown in FIG. 3 A; as noted briefly above, however, Active Table 
360 may include only active, or currently "good" or responsive, CC Servers. 

The entry in the Index column 3 10 of Active Table 360 may represent the CC 
10 Server ID. An active CC Server may be defined as one with a current time stamp or 
heartbeat, for example. Accordingly, every entry in the State column 350 in Active 
Table 360 will be "started," indicating an active or currently responsive CC Server. 
Q Active Tabic 360 is illusLfaicu as having a number, <~~ n, cf entries; the number of 

active CC Servers may be less than the total number of CC Servers employed by the 
Jlj 15 system. 

=P FIG. 4 is a simplified block diagram illustrating the form and composition of 

3 J jj 

one embodiment of a heartbeat message. The CC heartbeat 400 (which may be a 
JL UDP Broadcast message as described above, for example) may be in a binary 

SI protocol and may contain one or more of the following components: Protocol ID; CC 

1x0 

n 20 Instance ID; CC SIP Port; and CC State. 

In one embodiment, the value in the Protocol ED field 460 may be the same 
for all heartbeat messages, for example: OxDEADFACE (where the "Ox" prefix is a 
convention indicating hexadecimal notation). This value may identify the protocol 
of the heartbeat to the LM Server; such identification may be desirable in the event 
25 that another network component sends other types of messages in accordance with a 
different protocol to the high bandwidth port of the LM Server. The Protocol ID 
value may also allow load management software or other programming code to 
identify byte ordering changes. 

The value in the CC Server ID field 410 may identify a particular instance of 
30 the sending CC Server. Accordingly, this identifier may correspond to the Index 
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field in the CC Server Table and the Active Table, and may facilitate logging of the 
heartbeat message in the appropriate location in the foregoing tables. The value in 
the CC SIP Port field 430 may identify the port being used by the sending CC Server 
for SIP signaling, and may correspond to the SEP Port field in the CC Server Table. 
5 Finally, the value in the CC State field 450 may indicate the run state of the sending 
CC Server, and may correspond to the value in the State columns of the CC Server 
Table and the Active Table. 

As noted above, the LM Server and appropriate load management software 
resident thereon, for example, may be apprised of the condition and status of each 
10 CC Server in the Server Farm through, among other things, receipt of broadcast 
heartbeat messages from all CC Servers. In operation, the LM Server and its 
firmware and software components may decode a received heartbeat message and 
Q: update ihe CC Server Table row indicated by the heartbeat message CC Server ED 

,j§ field 410; the EP address, SIP Port, and State information in the appropriate row of 

^ 15 the CC Server Table may be updated with the appropriate information decoded from 

»E the heartbeat message. Additionally, the timestamp field in the CC Server Table 

5 J I 

Cj may be updated using, for example, the LM Server system clock time. 

3 L. FIG. 5A is a simplified flow diagram illustrating one embodiment of a 

U 

%! method of creating an Active Call Control Server Table such as depicted in FIG. 3B. 

S 20 A heartbeat message is received by an load management server or module at block 

p 51 1; as described in detail above, a heartbeat message may generally contain a data 

field for identifying the CC Server from which the heartbeat originates (in this 
example, such a data field may be the CC Server ID 410 as illustrated in FIG. 4). A 
system and method of load management may use the CC Server ED to enter the CC 
25 Server into the CC Server Table (block 512). As indicated at block 513, the CC 
Server Table may grow to a size, n, equal to the total number of CC Servers in the 
Server Farm. 

As set forth in detail above, heartbeat messages and timestamps may be 
employed to monitor which CC Servers in the Server Farm are presently responsive 
30 or capable of accepting data processing loads. In that regard, a system and method 
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of load management may create an Active Table such as illustrated in FIG. 3B, 
through successive or iterative examination of the timestamps for each server in the 
CC Server Table. At each loop through the CC Server Table (block 514), timestamp 
fields may be inspected and compared to current system time, for example. 
5 At decision block 515, only servers with current timestamps are accepted for 

the Active Table. A system and method of load management may use the CC Server 
ID to enter the responsive CC Server into the Active Table (block 516). As indicated 
at block 517, the Active Table may grow to a size, <= n (i.e. less than or equal to the 
total number of CC Servers in the Server Farm). 

10 FIG. 5B is a simplified flow diagram illustrating the general operational flow 

of one embodiment of a system and method of managing data transmission loads. In 
the FIG. 5B embodiment, all data messages inbound for processing may be received 
and directed to the LM Server (blocks 521 and 522); this reception and routing of 
data packets may be supported, for example, through use of a single IP address for 

15 the LM Server and the entire Server Farm as described above. The LM Server may 
decode enough of the data packet or message to ascertain the Call ID or other unique 
identifier (block 523); as described above with reference to FIG. 2, a unique 
identifier, such as a Call ID field in a SIP message, may serve as an indication of the 
network transaction or call with which the particular data packet is associated. 

20 As indicated at blocks 524 and 525, the Call ID or identifier may then be 

hashed in accordance with an appropriate hash function, the output of which may be 
supplied to a modulo function which may compute the modulo of the hash results 
over the number of active CC Servers as described above. 

In the FIG. 5B embodiment, the resulting value of the foregoing 

25 computations, i.e. the calculated modulo of the hashed CC Server ID, may be used to 
compute an index for the Active Table described above with reference to FIGS. 3B 
and 5A. The proper row in the Active Table may then be accessed, and the Table 
entry corresponding to the correct CC Server may be retrieved (block 527). In some 
embodiments, once the proper CC Server has been identified and its Active Table 

30 entry has been retrieved, load management hardware and software may verify that 
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acceptable values exist in both the Status and Timestamp fields of the CC Server 
Table; alternatively, such verification may be omitted, since the responsiveness of 
every CC Server may be confirmed during creation of the Active Table. Finally, at 
block 528, the LM Server or module may route the data packet or message to the 
5 indexed CC Server using EP address and SIP port information specified the 
appropriate columns for the specific CC Server Table entry. 

FIG. 6 is a simplified flow diagram illustrating the general operational flow 
of another embodiment of a system and method of managing data transmission loads. 
In the FIG. 6 embodiment, the operations depicted at blocks 601-604 may generally 
10 correspond to blocks 521-524 described above. 

As generally illustrated in FIG. 6, the results of the hash function (or any 
calculated modulo thereof) may be used to compute an index for the CC Server 
=-j laoie (no. such mat me laoic ciiuy coiic&ponuing to mo con ecu uvi»w 

may be retrieved (block 605). Once the proper CC Server has been identified and its 
^ 15 Table entry has been retrieved, load management hardware and software may verify 

S J5 that acceptable values exist in both the Status and Timestamp fields of the CC Server 

IJI 

Cj Table for the associated CC Server (decision block 606). Finally, at block 608, the 

Ei LM Server or module may route the data packet or message to the indexed CC 

O 

■y Server using IP address and SIP port information specified in the appropriate 

J2J 20 columns for the specific CC Server Table entry. 

O Since the Table indexed at block 605 is the CC Server Table of FIG. 3 A (as 

opposed to the Active Table of FIG. 3B), the verification at block 606 may result in 
the detection of a failed CC Server based upon unacceptable values in either the 
Status or Timestamp fields; in other words, an expired Timestamp or a value other 

25 than "Started" in the Status field may be interpreted by the system as indicative of a 
failed CC Server, as described above. 

If the Status of the CC Server is not identified as "Started" in the CC Server 
Table, for example, the LM Server and programming code may route the data packet 
or message to an alternate CC Server; a load management system and method may 

30 increment the Index value (block 607) and loop back to block 605 to identify and to 
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select the next CC Server in the Table. A similar iterative procedure employing 
blocks 605-607 may be executed if the Timestamp for an identified CC Server is out 
of range with respect to the configured heartbeat decay value, for example. The data 
packet or message may be routed to . an alternate CC Server selected from the Table 
5 in the foregoing manner. Those of skill in the art will appreciate that other methods 
of identifying an alternate CC Server may be employed. 

In accordance with the foregoing, a system and method of data transmission 
load management may identify an appropriate CC Server to which an incoming 
message may be routed. In addition, a system and method of load management may 
10 employ either of two thread models as described below. 

Load management functionality may be implemented in the form of one or 
more software or firmware load management modules in addition to, or in lieu of, 
U the LM Server described in detail above. In one embodiment, an LM system 

,rj (whether embodied in processors, storage media, memory, interface cards, and other 

15 hardware, or alternatively in server-side load management software and firmware 
programming instructions) may consists of a single thread, i.e. one which may read 

ui 

\j from both the SIP (or other data) port and the heartbeat port, for example. Data 

^ messages may be handled sequentially in the single thread. Heartbeat messages may 

fear 

''"-4 be employed simply to update fields in the CC Server Table as described in detail 

W 

20 above, whereas data messages may cause the LM system to index into the CC Server 

Table, access data records, and forward each data packet to the proper CC Server. 

Those of skill in the art will appreciate that discrepancies in message input 

rates between the ports may affect overall message throughput in this embodiment. 

For example, if the rate of message input at one port is significantly different than 
25 the rate of message input at the other port, a backlog of messages may develop at the 

high rate port. Accordingly, under certain circumstances, an LM system responsive 

to changing load conditions may service one port more frequently than the other. 

This embodiment may be optimized through use of dynamic port service rate 

adjustments. 
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In an alternative embodiment, two separate threads may be created, for 
example; one thread may be dedicated to heartbeat message handling, while the other 
thread may be dedicated to data message handling. In systems employing such a 
dual thread strategy, the CC Server Table may be protected from data corruption 
5 through implementation of a mutex (mutual exclusion), preventing simultaneous 
access of data records in the Table by the multiple threads. 

In one embodiment supporting load management redundancy, an LM system 
may be implemented as a plurality of completely stateless message processors; such 
a system comprising a number of stateless load managers may employ a load 
10 balancing router. The router may accept UDP packets broadcast by each load 
manager, and may impose a least-cost routing algorithm to balance total system load. 

As noted above, a CC Server may host a paired CLC/SLC. Similar to the LM 
system, the foregoing uisuibuieu call control functionality may be implemented in 
software or firmware call control modules in addition to, or in lieu of, the CC Servers 
15 described in detail above. In operation, each call control component, whether 
embodied in a CC Server or a dedicated call control software module, may reside on 
a server platform and may be responsible for full processing of data messages in a 
server-side data processing system. 

For load balancing and optimization of system resources, each CC 
20 component may periodically report its current load status and residual processing 
capacity to the LM system, for example, employing a specified heartbeat protocol; 
additionally or alternatively, each CC component may report on current capacity 
responsive to queries from the LM system. In this embodiment, a redundant load- 
balanced LM system may receive broadcast UDP from each CC component or 
25 module. Additionally, a CC component may be required to update the "Record 
Route" and "via" headers for each SIP message directed to the LM system's IP 
address. 

In the case of CC Server or component failure, the LM system may forward 
remaining messages (for any open transaction on the failed CC Server, for example) 
30 to an alternate CC Server in the CC Server Table. In order to accommodate such 
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failures, CC Servers may handle mid-transaction messages (e.g. 200 OK, progress, 
and the like) at any time. In response to a fail event, the alternate CC Server may act 
as a pure proxy, simply forwarding messages to the intended destination and logging 
such messages or data to a Fault, Configuration, Accounting, Performance, and 
Security (FCAPS) module. 

Additionally, an Agent may be associated with each CC Server; in this 
embodiment, an Agent may be responsible for starting each CC component local to 
the server on which the Agent is executing. The Agent may autostart the CC 
component, monitor its process status, and restart the process when it dies. 

The present invention has been illustrated and described in detail with 
reference to particular embodiments by way of example only, and not by way of 
limitation. Those of skill in the art will appreciate that various modifications to the 

Therefore, it is intended that the invention be considered as limited only by the scope 
of the appended claims. 
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